Counting Function Theorem for Multi-Layer Networks
نویسنده
چکیده
We show that a randomly selected N-tuple x of points ofRn with probability> 0 is such that any multi-layer percept ron with the first hidden layer composed of hi threshold logic units can implement exactly 2 2:~~~ ( Nil) different dichotomies of x. If N > hin then such a perceptron must have all units of the first hidden layer fully connected to inputs. This implies the maximal capacities (in the sense of Cover) of 2n input patterns per hidden unit and 2 input patterns per synaptic weight of such networks (both capacities are achieved by networks with single hidden layer and are the same as for a single neuron). Comparing these results with recent estimates of VC-dimension we find that in contrast to the single neuron case, for sufficiently large nand hl, the VC-dimension exceeds Cover's capacity.
منابع مشابه
بررسی فرایند نورد متقارن ورق های سه لایه با استفاده از تابع جریان و تئوری حد بالا
In this paper, a mathematical model for symmetrical multi-layer sheet rolling, in which the layers are unbounded before rolling, by using the upper bound method and stream function theorem is proposed. Using this model, we can investigate the plastic deformation behavior of sheets at the roll gap during rolling. Effect of various rolling conditions such as initial and final thickness and flow s...
متن کاملComparing Two Methods of Neural Networks to Evaluate Dead Oil Viscosity
Reservoir characterization and asset management require comprehensive information about formation fluids. In fact, it is not possible to find accurate solutions to many petroleum engineering problems without having accurate pressure-volume-temperature (PVT) data. Traditionally, fluid information has been obtained by capturing samples and then by measuring the PVT properties in a laboratory. In ...
متن کاملImplementation of a programmable neuron in CNTFET technology for low-power neural networks
Circuit-level implementation of a novel neuron has been discussed in this article. A low-power Activation Function (AF) circuit is introduced in this paper, which is then combined with a highly linear synapse circuit to form the neuron architecture. Designed in Carbon Nanotube Field-Effect Transistor (CNTFET) technology, the proposed structure consumes low power, which makes it suitable for the...
متن کاملCounting small subgraphs in multi-layer networks
Motivated by the prevalence of multi-layer network structures in biological and social systems, we investigate the problem of counting the number of occurrences of (small) subgraphs or motifs in multi-layer graphs in which each layer of the graph has useful structural properties. Making use of existing meta-theorems, we focus on the parameterised complexity of motif-counting problems, giving co...
متن کاملPredicting the Grouting Ability of Sandy Soils by Artificial Neural Networks Based On Experimental Tests
In this paper, the grouting ability of sandy soils is investigated by artificial neural networks based on the results of chemical grout injection tests. In order to evaluate the soil grouting potential, experimental samples were prepared and then injected. The sand samples with three different particle sizes (medium, fine, and silty) and three relative densities (%30, %50, and %90) were injecte...
متن کامل